
What is claimed is 

1. An image synthesizing method of synthesizing an 
actual scene image and a computer-graphics imag^/f comprising 
steps of : 

extracting a designated region from t)y& actual scene 
image ; 

appending three-dimensional shap^/ information to the 
extracted region; and 

constructing a computer-graphfics model representing 
information relating to said extracted region on the basis 
of information of said extracted region and said three- 
dimensional shape information. 

2. An image synthesizing method according to claim 1, 
further comprising a step of synthesizing the computer- 
graphics model representing the information relating to said 
extracted region t^ith another computer-graphics model for 
compound display/ 

3. An iipage synthesizing method according to claim 1, 
wherein 

the j^teps in claim 1 are performed for a plurality of 
frames c/onst i tut ing the actual scene image 
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a means for performing 4-connected or 8^connected 
labeling with each of the designated pixels as the starting 
po int ; 

a means for changing non-labeled regions to non- 
extracted regions; and 

a means for calculating /tn optical features of said 
extracted region, 

and for the next fr^ime, 

a means for labeldng; 

a means for calculating an optical features for each of 
regions assigned ^different labels; and 

a means for keeping, as the extracted region, a region 
having an opt/ical features close to the optical features of 
said extracted region in the preceding frame, and changing 
other regions to non-extracted regions. 



A method of displaying a three-dimensional shape 
model onto a two-dimensional plane, characterized in that a 
regular polyhedron containing therein whole or a part of the 
three-dimensional shape model is also displayed. 

^S^. A method of displaying a three-dimensional shape 

I 

model according to claim wherein 
said polyhedron is translucent. 



96 

7r 





A method of displaying a three-dimensional shape 
model according to claim wherein 

the color of said polyhedron is determined on the basis 
of the background color of the two-dimensional plane and on 
the color of the three-dimensional shape model. 
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A method of displaying a three-dimensional shape 
model according to claim 3^, wherein 

display mode of said three-dimensional shape model is 
changed in accordance with a relative positional relation- 
ship between a point designated by a pointing device and the 
position of the polyhedron. 

* 5 N^. An apparatus for displaying a three-dimensional 
shape model onto a two-dimensional plane, comprising: 

a means for calculating a regular polyhedron containing 
therein whole or a part of the three-dimensional shape 
model ; 

a pointing device; 

a means for judging a relative positional relationship 

i 

between a point designated by the pointing device and the 
position of said polyhedron; and 

a means for changing display mode of said three-dimen- 
sional shape model in accordance with the result of the 
judgment . 
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4. An image synthesizing method according to c/aim 2, 
wherein 

the steps in claim 2 are performed for a plurality of 
frames constituting the actual scene image 

5. An image synthesizing apparatus yfor synthesizing an 
actual scene image with a computer-graphics image, 
comprising : 

a means for extracting a designated region from the 
actual scene image; 

a means for appending threfe-dimens ional shape 
information to the extracted ^region; and 

a means for constructing a computer-graphics model 
representing information /elating to said extracted region 
on the basis of information of said extracted region and 
said three-dimensional/ shape information . 

6. An image synthesizing apparatus according to claim 
5, further comprising 

a means for/synthesizing the computer-graphics model 
representing the information relating to said extracted 
region with aryother computer-graphics model for compound 
display . 



7, Aymethod of extracting a three-dimensional shape of 
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an object contained in an actual scene image, corpprising the 
steps of: 

preparing data of a plurality of geometric shapes 
beforehand ; 

extracting a region corresponding /to said object from 
the actual scene image; 

selecting one of the geometric/ shapes and displaying 
the selected shape on a screen wpere the extracted region is 
displayed ; and 

adjusting the position, Orientation, and size of said 
shape to make said shape co/ncide with said extracted 
region . 

8. An apparatus f/or extracting a three-dimensional 
shape of an object c/Sntained in an actual scene image, 
comprising steps oj 

a means for preparing data of a plurality of geometric 
shapes beforehand; 

a means for extracting a region corresponding to said 
object from trie actual scene image; 

a means for selecting one of the geometric shapes and 
displaying/ the selected shape on a screen where the extract- 
ed region is displayed; and 

an/ adjusting means for adjusting the position, orien- 
tatio/f, and size of said shape to make said shape coincide 
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with the extracted region. 

9. A three-dimensional shape extraction apparatus 
according to claim 8, wherein 

said adjusting means includes a means X or automatically- 
making the adjustments on the basis of tiyd shape of said 
object in the actual scene image 

10. A three-dimensional shape Extracting apparatus 
according to claim 8, further comprising 

a means for mapping image X n ^ ormat i° n °f said extracted 
region onto surfaces of the slykpe adjusted by said adjusting 
means, and for displaying th£ mapped result 



11. A method of extracting a designated region from an 
image, comprising steps/ of : 

designating a plurality of pixels within a region to be 
extracted ; 

calculating a/predetermined features for the designated 
pixels ; 

calculating a maximum value and a minimum value of the 
calculated features ; 

calculating features for pixels inside and outside the 
region to be extracted; and 

seleqfting pixels whose features are between said 
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maximum value and said minimum value, 

wherein a region made up of the selected pi^4ls is 
designated as an extracted region. 

12. A region extracting method according to claim 11, 
further comprising steps of : 

assigning a value to the pixels jCn said extracted 
region and a different value to the/ pixels in non-extracted 
regions; and 

assigning an intermediate ^alue between said two values 
to pixels located along an oiyter edge of the boundary of 
said extracted region, 

wherein an image is generated by using these assigned 
values . 

13. A method of/ extracting a designated region from an 
image, comprising ysteps of: 

designating/a plurality of pixels within a region to be 
extracted ; 

calculat/ng a prescribed features for the designated 
pixels ; 

calculating a difference in the calculated features 
between acdjacent pixels within the designated pixels; 

calculating a maximum value of the calculated 
difference; and 
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connecting four connected pixels or eight connected 
pixels of which the difference in the feature/ between 
adjacent pixels is smaller than said maximum value, with 
each of the designated pixels as a starting point, 

wherein a region made up of the thus connected pixels 
is designated as an extracted region/ 

14. A region extracting method according to claim 13, 
further comprising steps of: / 

assigning a value to the/pixels in said extracted 
region and a different value/ to the pixels in non-extracted 
regions; and / 

assigning an intermediate value between said two values 
to pixels located along/an outer edge of the boundary of the 
extracted region, / 

wherein an image is generated by using these assigned 
values. / 

15. A region extracting method according to claim 12, 
further comprising a step of 

assigning/ individually different intermediate values to 
a plurality ok pixels adjacent each other along a direction 
moving farther from said extracted region. 

16. d region extracting method according to claim 14, 
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further comprising a step of 

assigning individually different intermediate values to 
a plurality of pixels adjacent each other along a/direction 
moving farther from said extracted region. 



17. A method of extracting a designated region from an 
image, comprising steps of; 

designating a plurality of pixe^ within a region to be 
extracted ; 

calculating a predetermined/features for the designated 
pixels ; 

calculating a maximum v^lue and a minimum value of the 
calculated features ; 

calculating feature^ for pixels inside and outside the 
region to be extracted; 

determining whether the calculated features are within 
a range between said maximum value and said minimum value; 

assigning a ponstant K to the pixels within said range; 
calculating the difference between the features of the 
pixels outside/ the range and said maximum value or said 
minimum value; and 

assigning to the pixels outside said range a value 
calculated: by subtracting from the constant K a value 
determined as a function of said difference, 

wnerein an image is generated by using these assigned 
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18. A method ,of extracting a designated region j^rom an 
image, comprising steps of: 

designating a plurality of pixels within region to be 
extracted ; 

calculating a plurality of prescribe/ features for the 
designated pixels ; 

calculating a maximum value and/a minimum value of each 
of the calculated features; 

calculating features for pixels inside and outside the 
region to be extracted; 

determining whether ea6h of the calculated features is 
within a range between s^id maximum value and said minimum 
value ; 

assigning a constant K to the pixels within said range; 

calculating the difference between each features of the 
pixels outside th4 range and said maximum value or said 
minimum value; And 

assigning to the pixels outside said range a value 
calculated by subtracting from the constant K a value 
determined/in relation to said difference of each of the 
f eatures, 

wtyerein an image is generated by using these assigned 
values , 
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19. A method of extracting a designated region from an 
image, comprising steps of: / 

designating a plurality of pixels within ar region to be 
extracted; / 

calculating a predetermined features yfor the designated 
pixels; / 

calculating a mean and a variancye of the calculated 
features; / 

calculating features for pixels inside and outside the 
region to be extracted; / 

determining whether the ^calculated features are within 
a range defined by said meari and said variance; 

assigning a constant /K to the pixels within said range; 

calculating a deviation of the features of the pixels 
outside said range wit^h respect to said mean; and 

assigning to th^ pixels outside said range a value 
calculated by subtracting from the constant K a value 
determined in relation to said deviation, 

wherein an/image is generated by using these assigned 
values. / 

20. A method of extracting a designated region from an 
image, comprising steps of: 

designating a plurality of pixels within a region to be 
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extracted; / 

calculating a plurality of prescribed features iojt the 
designated pixels; / 

calculating a mean and a variance of each oy the 
calculated features; / 

calculating features for pixels inside /and outside the 
region to be extracted; / 

determining whether each of the calculated features is 
within a. range defined by said mean a«d said variance; 

assigning a constant K to the ypixels within said range; 

calculating a deviation of each features of the pixels 
outside said range with respect/ to said mean; and 

assigning to the pixels youtside said range a value 
calculated by subtracting from the constant K a value 
determined in relation to/said deviation of each of the 
features, / 

wherein an image /is generated by using these assigned 
values. / 

21. A method^ of extracting a designated region from an 
image, comprising steps of: 

designating a plurality of pixels within a region to be 
extracted; / 

performing 4-connected or 8-connected labeling with 
each of t^ie designated pixels as the starting point; and 
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changing non-labeled regions to non-extracted /regions, 

22. A method of extracting a designated negion from an 
image consisting of a plurality of frames, comprising steps 
of: / 

for one frame, / 

designating a plurality of pixeLs within a region to be 
extracted; / 

performing 4-connected or 8^connected labeling with 
each of the designated pixels a/s the starting point; 

changing non-labeled regions to non-extracted regions; 
and / 

calculating a geometric features of the extracted 
region, / 

and for the next /frame, 

performing labeding ; 

calculating a/geometric features for each of regions 
assigned different labels; and 

keeping, as the extracted region, a region having a 
geometric feat/ures close to the geometric features of the 
extracted region in the preceding frame, and changing other 
regions to /non-extracted regions. 

method of extracting a designated region from an 
isting of a plurality of frames, comprising steps 
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of: 

for one frame, 

designating a plurality of pixels within a X e 2ion to be 
extracted ; 

performing 4-connected or 8-connected labeling with 
each of the designated pixels as the starring point; 

changing non-labeled regions to nc^n-ext racted regions; 

and 

calculating an optical featured of the extracted 
region , 

and for the next frame, 
performing label ing ; 

calculating an optical/ features for each of regions 
assigned different labels/ and 

keeping, as the extracted region, a region having an 
optical features close to the optical features of the 
extracted region in ythe preceding frame, and changing other 
regions to non-extracted regions. 



24. An apu&ratus for extracting a designated region 
from an imageY comprising: 

a means/ for designating a plurality of pixels within a 
region to pe extracted; 

a me>ans for calculating a predetermined features for 
the des/gnated pixels; 
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a means for calculating a maximum value and a minimum 
value of the calculated features; 

a means for storing the calculated maximum value and 
minimum value; 

a means for calculating features for pixels inside and 
outside the region to be extracted, and for selecting pixels 
whose features are between said maximum value and said 
minimum value, 

wherein a region made up of the selected pixels is 
designated as an extracted region. 

25 . A region extracting apparatus according to claim 
24, further comprising: 

a means for assigning a value to the pixels in said 
extracted region and a different value to the pixels in non- 
extracted regions; and 

a means for assigning a value intermediate between the 
above two values to pixels located along an outer edge of 
the boundary of said extracted region, 

wherein an image is generated using these assigned 
values . 

26. An apparatus for extracting a designated region 
from an image, comprising: 

a means for designating a plurality of pixels within i 
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region to be extracted; 

a means for calculating a predetermined feati^fes for 
the designated pixels; 

a means for calculating a difference in Jb^he calculated 
features between adjacent pixels within the/designated 
pixels ; 

a means for calculating a maximum /alue of the 
calculated di f ference ; 

a means for storing the calculated maximum value; and 

a means for connecting, with/^ach of the designated 
pixels as the starting point, four connected pixels or eight 
connected pixels for which the/ difference in the features 
between adjacent pixels is sinaller than said maximum value, 

wherein a region made/up of the thus connected pixels 
is designated as an extracted region. 



27. A region extracting apparatus according to claim 
26, further comprising: 

a means for assigning a value to the pixels in said 
extracted region And a different value to the pixels in non- 
extracted regions; and 

a means yov assigning an intermediate value between 
said two vaLues to pixels located along an outer edge of the 
boundary of said extracted region, 

wherein an image is generated by using these assigned 
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values . 

28. A region extracting apparatus according t^^claim 
25, further comprising / 

a means for assigning individually different inter- 
mediate values to a plurality of pixels adjacent each other 
along a direction moving farther from sa^d extracted region. 

29. A region extracting apparatus according to claim 
27, further comprising / 

a means for assigning individually different inter- 
mediate values to a plurality pi pixels adjacent each other 
along a direction moving farther from said extracted region. 

30. An apparatus for/ extracting a designated region 
from an image, comprising: 

a means for designating a plurality of pixels within a 
region to be extracted; 

a means for calculating a predetermined features for 
the designated pi/xels; 

a means fcvr calculating a maximum value and a minimum 
value of the cralculated features; 

a means/ for storing the calculated maximum value and 
minimum vaLue; 

a meatns for calculating features for pixels inside and 
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outside the region to be extracted, and for determining 
whether the calculated features are within a range between 
said maximum value and the minimum value; / 

a means for assigning a constant K to Ime pixels within 
said range ; / 

a means for calculating the difference between the 
features of the pixels outside said Mnge and the maximum 
value or the minimum value; and / 

a means for assigning to the/pixels outside said range 
a value calculated by subtracting from the constant K a 
value determined in relation yo said difference, 

wherein an image is generated by using these assigned 
values. / 

31. An apparatus for extracting a designated region 
from an image, comprising: 

a means for designating a plurality of pixels within a 
region to be extracted; 

a means f or ycalculat ing a plurality of predetermined 
features for th^ designated pixels; 

a means tpv calculating a maximum value and a minimum 
value of eacn of the calculated features; 

a means for storing the calculated maximum value and 
minimum value ; 

a m^ans for calculating features for pixels inside and 
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outside the region to be extracted, and for determining 
whether each of the calculated features is withirr a range 
between said maximum value and said minimum va/ue; 

a means for assigning a constant K to %/txe pixels within 
said range; 

a means for calculating the difference between each 
features of the pixels outside said r/nge and said maximum 
value or said minimum value; and 

a means for assigning to the /pixels outside said range 
a value calculated by subtracting from the constant K a 
value determined in relation tp said difference of each of 
the features, 

wherein an image is g^fierated by using these assigned 
values . 

32 . An apparatus £or extracting a designated region 
from an image, compri/sing: 

a means for designating a plurality of pixels within a 
region to be extracted; 

a means for/calculating a predetermined features for 
the designated /pixels; 

a means for calculating a mean and a variance of the 
calculated features; 

a meanrs for storing the calculated mean and variance; 

a means for calculating features for pixels inside and 
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outside the region to be extracted, and determining whether 
the calculated features are within a range defined by said 
mean and variance; / 

a means for assigning a constant K to the/pixels within 
said range; / 

a means for calculating a deviation of the features of 
the pixels outside said range with respect to said mean; and 

a means for assigning to the pixels outside said range 
a value calculated by subtracting f/om the constant K a 
value determined in relation to said deviation, 

wherein an image is generated by using these assigned 
values. / 

33. An apparatus f or /extract ing a designated region 
from an image, comprising: 

a means for designating a plurality of pixels within a 
region to be extracted; 

a means for calculating a plurality of predetermined 
features for the clesignated pixels; 

a means foy calculating a mean and a variance of each 
of the calculated features; 

a means yror storing the calculated mean and variance; 

a means for calculating features for pixels inside and 
outside said region to be extracted, and for determining 
whether eAch of the calculated features is within a range 
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defined by said mean and said variance; 

a means for assigning a constant K to the pixels within 
said range; / 

a means for calculating a deviation of eacm features of 
the pixels outside said range with respect to said mean; and 

a means for assigning to the pixels outside said range 
a value calculated by subtracting from t/ne constant K a 
value determined in relation to said deviation of each of 
the features, / 

wherein an image is generated by using these assigned 
values. ^ / 

34. An apparatus for extracting a designated region 
from an image, comprising:/ 

a means for designating a plurality of pixels within a 
region to be extracted;/ 

a means for performing 4-connected or 8-connected 
labeling with each or the designated pixels as the starting 
point; and / 

a means for /changing non-labeled regions to non- 
extracted regioiis . 

35. An apparatus for extracting a designated region 
from an image consisting of a plurality of frames, com- 
prising: / 
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for one frame, 

a means for designating a plurality of pixels/within a 
region to be extracted; 

a means for performing 4-connected or 8-^onnected 
labeling with each of the designated pixel^ as the starting 
po int ; 

a means for changing non-labeled /egions to non- 
extracted regions; and 

a means for calculating a geometric features of said 
extracted region, 

and for the next frame, 
a means for labeling; 
a means for calculat irafg a geometric features for each 
of regions assigned different labels; and 

a means for keeping, as the extracted region, a region 
having a geometric features close to the geometric features 
of said extracted region in the preceding frame, and for 
changing other regions to non-extracted regions. 



36 • An apparatus for extracting a designated region 
from an image consisting of a plurality of frames, 
compr is ing : 

for one' frame, 

a means for designating a plurality of pixels within a 
region to/be extracted; 
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